Video Deck 



rier.k 



deck commands 
and time-codes 

234 




Close Caption 
Decoder 



commands & 
time-codes 




FIG. 3 



0 



software process 

I physical workstation 



■ video CaUloger workstation 


^ no 




^ CatsBogfr 






. audio cap<ire 




video capture 





Encoder #1 



auSio capture 



video capture 



eg, RealVideo ©lOOkbps 



Network (e.g„ TCP/IP) 



A. 



Encoder #2 



audio capture 



vi^o capture 



\ ZG? eg, MPEG-1 @1,5mbps 



127-^ 



v' ^ 



Encoder #3 



audio capture 



video capture 



eg, MPEG-il @ Smpbs 



102 



Analog 
Source 



r 



2-51 



Switcher 



,03 



signal 



I 



FIG. 4 



Media Capture Services 



4M0 



1 



Extensible Video Engine 



r 




GUI Input Capture 



GUI Display Update 



Output 



-550 




Feature Extractor 
Registration 

M72 


Event 

Registration 


Metadata Track 
RegistraUon 


Output Filter 
Registration 


St£ 


art-up Extensibility initialization 



M70 



7 



FIG. 8 



\ 



1 



From Deck Ctrlr 



Analog Video 



Analog Audio ASCII (e.g., OCAext) 



430 



Media Capture Servic|^5 



Timecode 
Capture 



Video 
Capture 
5^ 



Audio 
Capture 



Text 
Capture 

5ns 



Keyframe 
Extractor 



CC-text 
\ ^ Extractor 





C Audio Analysis 
Extractor 



C 



Speech-to- 
Extractor 



f Speaker 
V Extractor 



) 

5)' 

F 

:) 



Feature 



Extractor 



Framework 



550 




GUI 

Input 

Capture 

(Clips) 



r551 

I User 
^""^Input 



GUI 

Display 
Update 
Manager 



55M 



j w Screen 
T^Update 



540 



Output 

Filter 

Manager 



VDF 



XML 



Etc. 



Event Monitor 



Event 
Dictionary 



Event Dispatcher 



J — ► 



Actions 



FIG. 9 



Analog Audio Signal 



Audio Capture / Digitization 



Audio Signal Normalization 



1^ 



Digital Audio Signal 



Vocabulary 
Dictionary 




LpOO^ 



Audio Profiling 
Classification 



Speech 
Transcription 




Domain 
Dictionary 



Keywords Full Text Speakers 



Switch Control 
(On when speech 
is present) ^Q;-^2 



Speaker 
ID 



Speaker 
Dictionary 




6.08 
Audio Classes 



FIG. 10 



^gln Extensible Vide^ 
Engine initlelizaUon 




•702 



Uistall Built-in Track 
Types 



For each Track 
Plug-in do: 



Install Track Data 
Representation 



^ 70(p 



70M 



7IM 



Install Built-in Feature 
Extractors 



11L> 




For each Feature Exlracto^ 
Plug-in do: 



Register Feature E)dractor 



72.0 



Obtain Feature E>4ractor 
Track request and map to 
an installed Track Type 



Install Built-in Output 
Filters 



r 



lib 




lit 

Another \^ Yes 
'Feature Extractor? 



For each Output Filter 

Piug-in do: 



Install Output Filter and 
register on Save Menu 



734 



r 



73& 




For each Event 

Plug-in do: 



Register Event in 
^ Event Dictionary 



Register Event Handler 
and assolate v^ilh Event 



7M0 



No 




End 




7m 




Yes 



FIG. 11 




FIG. 12 




Schedule 1/30 sec. 
Timer Event 



W8 



Get Event 



%\0 



1 



Timer 
Event 



Process Feature 

Extraction 




Return 




SIM 



Yes 




GUI 




Process GUI Event 



No 




Commit Metadata 
Track Index 



Mark GUI for 
Redraw 



FIG. 13 




Process Feature: 
Exlracfion - Start 




SMI 



Obtain current 
Time Code 



SMS 



Capture Media 

Data (video, audio, text) 



J 



Z50 



2i 



For Each Installed 
Feature Extractor do: 
(spawn thread) 




Feature Extractor 
extracts metadata 



%5M 




ITiread 
(llghtvMeigifit 
:proc8S5)V 



Wait for all threads 
to complete (sync) 





A50> 


Insert Metadata 
mto Track index 


•> 




Mark GUI for Redraw 







^ — 

Return j 



FIG. 14 



CHTML Output <^ 
Begin 



Process Session 
Level Metadata 



Video Session 
HTML Frame and 
Playback info 



I'M 



Process Keyframes 
output as JPEG image 
nies 



9 01 



Process Keyframe 
Metadata with time 
code index into digital 
video; cro8»4idexto 

JPEG files 



Process CC-text 
Metadata with links 
to keyframe frame 


_ > 








Process Clip Uvel 
Ktetadata with links 
to keyframe and 
CC-lext frames 


_ > 




> 


, ^^'^ 


Output main HTML 
page Incorporating 
frames and video 
play-out helper app. 


^ > 




> 






z: 



Main 

HTML Frame 



C 



End 



FIG. 16 



